Papers with temporal and causal reasoning
Exploring Question Guidance and Answer Calibration for Visually Grounded Video Question Answering (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for videoQA lack temporal localization labels, leading to inaccurate localization. |
| Approach: | They propose a Question-Guided and Answer-Calibrated TRansformer which guides and calibrates localization using question and option texts without localization labels. |
| Outcome: | The proposed model achieves comparable accuracy to large-scale pretrained models and leads in localization aspects. |
Large Language Models are Temporal and Causal Reasoners for Video Question Answering (2023.emnlp-main)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have shown remarkable performances on a wide range of natural language understanding and generation tasks. |
| Approach: | They propose a framework that exploits linguistic shortcuts and mitigates 'linguistic bias' by flipping the source pair and target label to understand their complex relationships. |
| Outcome: | The proposed framework outperforms both LLMs-based and non-LLMs- based models on five challenging VideoQA benchmarks. |
Can you SPLICE it together? A Human Curated Benchmark for Probing Visual Reasoning in VLMs (2025.findings-emnlp)
Copied to clipboard
Mohamad Ballout, Okajevo Wilfred, Seyedalireza Yaghoubi, Nohayr Muhammad Abdelmoneim, Julius Mayer, Elia Bruni
| Challenge: | SPLICE is a benchmark designed to probe event-based reasoning across multiple dimensions. |
| Approach: | They introduce a human-curated benchmark to probe event-based reasoning across multiple dimensions. |
| Outcome: | The proposed benchmark includes 3,381 human-filtered videos spanning 12 categories and 180 sub-categories . results show that state-of-the-art vision-language models struggle to match human performance . |